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(54) Title of the Invention: RECOGNITION DEVICE FOR TRAVELING VEHICLE 
SPECIFICATIONS 

1 . Title of the Invention: Recognition Device for Driven Vehicle 

2. Scope of the Patent's Claim 

Recognition device for traveling vehicle, characterized by the fact that it is 
equipped with a color picture taking means, which takes pictures in front of a traveling 
vehicle; 
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a color image formation means, which forms a color image corresponding to 
respective colors, based on the image signal filmed with this picture taking means; 

a characteristics extracting means, which extracts the signal image with respective 
colors corresponding to tail lamps or headlights, based on the color image signal obtained 
with said means; 

a recognition means, which recognizes the presence of tail lamps or headlights 
from the image signal extracted with the characteristics extraction means; 

a calculation means, which calculates the relative velocity and the distance of the 
vehicle from a preceding vehicle based on the detected tail lamp image; 

and an execution means, which executes headlight control based on the 
recognition result of said recognition means; 

wherein when a status has been recognized in which a preceding or an oncoming 
vehicle is present at a minimum with the recognition of said headlights, control is 
exercised in order to switch the headlights of the vehicle to low beams. 

3. Detailed Explanation of the Invention 
(Sphere of Industrial Use) 

This invention relates to a recognition device for a traveling vehicle, in particular 
to a recognition device which makes it possible to recognize the presence of the tail 
lamps of a vehicle traveling in front of a car during night time, as well as to recognize the 
presence of the headlights of an oncoming vehicle, so that the headlights of the car itself 
can be controlled automatically. 

(Background Technology) 

The headlights lamps are turned on when a vehicle is operated during night time, 
in particular when only few cars are being operated, and the operation of the headlights is 
usually set to high beams under these circumstances. 

[page 2] 

However, if an oncoming vehicle is present during the operating state when the 
high beams are operated, or if a vehicle is present in the vicinity in front of the vehicle, 
the driver must switch the status of the headlights to low beams not to obstruct the visual 
field of the driver of an oncoming car or of a car traveling in front of the vehicle. 
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Moreover, since this kind of the control of the beams of the headlight may be annoying 
for the driver, in particular when the vehicle is operated on a road that has many curves, 
this can cause complicated driving operations. In addition, if a vehicle traveling in front 
of the car is present, the distance between the car in question and the vehicle in front of 
it, as well as the relative speed of the vehicle traveling in front must be accurately 
recognized by the driver in question. To ensure safer operations, it is therefore necessary 
to determine accurately the relative relationship to a vehicle traveling in front. 

(Problems to Be Solved By This Invention) 

In view of the problems described above, the present invention provides a device 
for recognition of traveling vehicles, which enables automatic control over the high 
beams and low beams of the headlights, for example in response to the status of vehicles 
present in front of a car, in particular when the car is traveling during night time, and 
which also makes it possible to issue a warning for the driver in response to the relative 
relationship between the car in question and a car traveling in front of it. 

(Means to Solve Problems) 

Specifically, according to the device for recognition of a traveling vehicle relating 
to this invention, a picture taking device is set up, such a for example a color TV camera 
which films the situation in front of a traveling vehicle, so that based on the camera 
image signal filmed with this picture taking device, color image signal is formed by 
extracting the characteristics of the headlights and tail lamps, which are extracted as 
color characteristics, so that because headlights in front of the car and tail lamps are 
recognized, beam control can be realized automatically based on the result of this 
recognition. Furthermore, the relative speed and the relative distance of a preceding car 
can be calculated based on the image signal of the recognized tail lamps. 

(Operation) 

According to the device for recognition of a traveling car which has the 
construction described above, because the headlights and the tail lamps of a vehicle 
traveling in front can be recognized based on its color characteristics, the operator can 
thus be notified about the presence of oncoming vehicle which is recognized in this 
manner, and about the presence of a vehicle traveling in front of the car. In addition, 
since the conditions requiring to switch the headlights from high beams to low beams can 
be detected based on the result of this recognition, this makes to possible to realize the 
headlight beam control automatically when the recognition conditions have been set. 
Also, since the relative speed and the distance of the vehicle from a car in front of it can 
be calculated based on the recognition of tail lamps, a warning can be generated for the 
driver in a situation when there is for instance the danger of a rear-end collision and in 
similar situations. 

(Embodiment) 
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The following is an explanation of one embodiment of this invention based on the 
enclosed figures. Figure 1 shows the construction of this embodiment, which is equipped 
with a TV camera 11. This TV camera 1 1 is set up so that it is installed in the front part 
of the vehicle 12, such as a passenger car as shown for example in Figure 2, in order to 
film the situation in front of the car 12, in particular a car 121 traveling in front of it, but 
the setup also makes it possible to film oncoming cars, such as the car 122. In this case, it 
is clear that the headlights of the car 122 will be filmed with a white color and the tail 
lamps of the car 121 will be filmed with a red color, in particular at night. 

The video signal, which is filmed with this TV camera 1 1, is supplied to a 
decoder 13, this decoder 13 forms color image based on said video signal as R (red), G 
(green) and (B) blue color image, and this R, G, B color image is supplied to an image 
signal processing part 14. 

[page 3] 

This image processing part 14 extracts the characteristics of the tail lamps as red 
light characteristics, and the characteristics of headlights are extracted as white color 
characteristics based on said R, G, B color image, so that when for example a binary 
image signal is extracted, based on this extracted video signal, the presence of headlights 
or of tail lamps can be recognized with this design in the film image. After that, the result 
of this recognition is furnished to an execution part 15. 

To this execution part 1 5 is also supplied a detection signal corresponding to the 
vehicle velocity obtained from a vehicle velocity sensor 16, and a signal indicating the 
set status of high beams or low beams of the headlights, obtained from a switch 17, 
which switches on the headlights. Further, based on said recognition information, vehicle 
velocity information, and headlight information, the execution part 15 controls the beams 
of the headlights and executes a warning notice operation issued for the driver. 

Figure 3 is a flowchart indicating the processing flow during the operating status 
of such a device, which starts when the car ignition key is inserted to start the car. After 
that, in step 101, when it is determined whether illumination of the headlight lamps is 
present or is not present at night time, the operation proceeds with step 102 if it is 
determined that this is night time. After that, the initializing setting is realized in step 122 
[sic]. During the initializing setting in step 102, the setting of the scanned part of the 
filmed image is realized, and also the conditions for extraction of characteristics are set in 
order to recognize tail lamps or headlights. 

Once the initial setting has been realized in this manner, the operation proceeds 
with the next step, step 103. In this step, the color image signal obtained from the 
decoder 13 based on the video signal obtained from the color TV camera 1 1 is 
incorporated and input to the image processing part 14. Next, the operation proceeds with 
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step 104. Because the extraction of characteristics are realized with the image processing 
part 14 from said color image signal in this step 104, the white color and the red color is 
intensified in the emitted colors. 

Because this image signal processing part 14, which can be constructed for 
example as shown in Figure 4, is equipped with a characteristics extraction part 141, 
color image signal corresponding to R, G, B is supplied from said decoder 13, and when 
its characteristics have been extracted by this characteristics extraction part 141, the input 
image signal is converted to a binary system, and because only information related to the 
headlights and tail lamps as the recognized target is fetched, the color signal 
corresponding to respective emission colors of the headlights and tail lamps is extracted. 
Also, because the condition type for extraction of these characteristics is preset, the 
image signal corresponding to this condition type can be extracted. 

If for example the white mission light color, such as the light which is emitted 
from headlights, creates a large value of respective components R, G, B, there is a small 
difference between the mutual values creating this state. Also, the condition formula for 
this white emission light can be created as follows: 

| R-G | <e/10 

| G-B | <e/10 

| R-R | <e/10 

4e/5<R.G.B (1) 

while the range for incorporation of R, G, B is set as 0 ~ e. 

In addition, because according to the red emission color emitted when the tail 
lamps are lit up, the value of R (red) will be more than twice as much as the value of G 
(green), or B (blue), the extraction condition formula for the emission of the red color 
from tail lamps can be created as follows: 

R > 2B, and R > 2 G (2) 

The image data having the characteristics extracted in step 104 is then stored in 
memory 142 in step 105. The storage of this image data can be realized for example in 
0.05 seconds. Further, the image data stored in this memory 142 is furnished in step 106 
to a recognition part 143 and a determination is made whether the image having these 
extracted characteristics is or is not a tail lamp image. 

Using this determination as a standard, it is determined whether 2 images 52, 53, 
having red color at the same height, are or are not present inside the range set in the 
image, so as to correspond to the range of a car line in which the car itself is traveling as 



shown in Figure 5 (A). If tail lamps are recognized during this step 106, the operation 
proceeds with step 107, in which a determination is made whether the headlight status is 
switched to the high beam status with the switch setting for the near or the far status, 
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If this is the high beam status of the headlights in step 107, the operation proceeds 
with step 108, in which the light control is operated to switch on the low beam 
headlights, and the operation then proceeds with step 109. In this case, the fact that the 
headlights were switched from high beams to low beams is stored in memory. This fact 
will be retained in the memory when the high beams status is created again, or it will be 
erased from memory if the ignition switch is released. In addition, if it has been 
determined in step 107 that the headlight status corresponds to low beams, the operation 
will proceed as is with step 109. 

In step 109, the image data, which is stored each 0.05 seconds in said memory 
142, is input to a calculation part 144. Next, during step 110, the distance Z from the 
vehicle to the vehicle traveling in front of it is calculated, and the relative velocity of the 
car traveling in the forward direction is also calculated. 

In this case, the distance Z from the vehicle to the vehicle traveling in front of it 
can be calculated for example based on the distance rl between the tail lamps 52 and 53, 
recognized as described above. Specifically, the distance rl is calculated as described 
below. 

Specifically, f, which is the focal distance of the TV camera 1 1 , distance Z 
from the lens of this camera 1 1 to the vehicle, and the magnification of the camera 1 1, set 
as p, can be established according to the following formula: 

P = f/Z (3) 

Also, the distance between said tail lamps, set to R, and said magnification p, 
which is set to "1", can be established according to the following formula: 

P = r/R (4) 

As one can see from the formulas (3) and (4) above, the distance Z between the 
vehicles can be determined according to the following formula: 

Z = f R / z (5) 

Therefore, since the calculation of the distance between the vehicles is realized 
each 0.05 seconds and said image data is stored, the relative velocity of the vehicle 
traveling in front of the car itself can be calculated from the distance between the 
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vehicles obtained in this manner each 0.05 seconds. In other words, since the image of 
the tail lamp shown in Figure 5 (A) is obtained as the same tail lamp image 0.05 seconds 
later as shown in Figure 5 (B), the distance between the tail lamp 52 and 53 will be 
changed from rl to r2. 

Also, when the distance Zl between the vehicles is calculated with this distance 
r2, the relative velocity V of the car in front of the vehicle can be calculated according to 
the following formula: 

V = (Z-Zl)/0.05 (6) 

Since the distance Z from the vehicle in front of the car and the relative velocity 
V have been determined with the calculation in step 1 10, the result of this calculation can 
be displayed in step 1 1 . 

The display means, which can be used in this step 111, can be for example a 
meter panel of the vehicle on which numbers are displayed. 

If tail lamps have been recognized in said step 106, the operation proceeds with 
step 1 12. Because the headlight recognition operation is carried out in step 1 12, the 
headlights of an oncoming car are recognized when it has been determined whether 2 
white color emissions 62, 63 are or are not present at the same height in a specified range 
corresponding to the car lane of an oncoming vehicle shown in Figure 6, if 2 white color 
emissions 62, 63 are present. 

If the headlights have been recognized in this step 1 12, the operation proceeds 
with step 1 13, the status of the headlights of the car itself is then recognized in the same 
manner in step 107, and if the headlights are switched to high beams, they will be 
switched to low beams in step 1 14. 

If no headlights were recognized in said step 1 12, it will be determined that no 
preceding vehicle and no oncoming vehicle is present, and the operation will proceed 
with step 1 15. In this step 1 15, the status set for the headlights in the past is determined 
from the content stored in the memory, and if it is determined that high beams were 
stored in the memory, the operation proceeds with step 1 1 6 and the headlights are 
switched to high beams. For example, if during the status when the vehicle was traveling 
with high beams the status was switched to low beams in step 108 or 1 14, as long as a 
previous high beams status is stored in memory, after a car in front of the vehicle has 
been passed, or after an oncoming vehicle has been passed, the headlights will be 
switched to high beams in step 1 16. 



[page 5] 
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In other words, when said device is used during travel at night, if a car is present 
in front of said vehicle, or if an oncoming car is present in front of this vehicle, for 
example during the high beams status of the headlights, the headlights will be 
automatically switched to high beams, so that stable road operations will be executed 
automatically. Also, it is particularly useful to know the precise status including the 
distance between the vehicles and the relative velocity, especially when the vehicle is 
traveling at night, because this function can be utilized as an effective means for 
prevention of rear-end collisions. Because in this case, the distance between the vehicles 
and the relative velocity is calculated, a rear-end collision can be anticipated based on 
this data, which makes it possible to generate a warning such as a warning sound for the 
driver, since such an occurrence is anticipated. In other words, this can be also used as a 
means preventing the driver from falling asleep while driving. 

Also, the TV camera taking pictures of the situation in front of the car is installed 
can be installed in any position as long as this position makes it possible to film the 
situation in front of the car. Further, the construction also makes it possible to modify the 
angle in which the camera is installed, for example so that the angle can be automatically 
controlled, for example according to the angle of steering operations. With this type of 
installation, monitoring of preceding cars can be effectively carried out when the camera 
is facing in the direction in front of the car. Further, because a safe distance between the 
vehicles can be set based on the absolute velocity of the car itself, if the distance has 
dropped to a status below this distance, as long as the driver is warned by a warning 
sound or a buzzer, this makes it possible to utilize the device effectively as a warning 
system ensuring safe operations. It is further also possible to employ delayed timer 
processing when control is exercised in the embodiment described above during 
switching from low beams to high beams. 

(Effect of the Invention) 

As was explained above, because the recognition device for recognition of a 
traveling car according to this invention enables a secure recognition of the presence of a 
vehicle traveling in front of the car, in particular at night, and of an oncoming vehicle, 
headlights can be controlled automatically based on the results of this recognition. 
Accordingly, because an operation that is essential for overall safety can be realized 
automatically while traveling at night, an important effect is thus realized affecting the 
safety of operations at night. Furthermore, because a warning operation can be also 
realized with various types of operations related to safety, the effect thus greatly expands 
the overall safety of driving operations. 

Brief Explanation of Figures 

Figure 1 shown a block diagram explaining a recognition device according to one 
embodiment of this invention, Figure 2 is a diagram explaining the status in which a TV 
camera is set up in said embodiment, Figure 3 is a flowchart explaining the operating 
status in said embodiment, Figure 4 is a diagram showing one construction example of 
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said embodiment, Figure 5 is a diagram explaining the image status when tail lamps are 
recognized, and Figure 6 is a diagram explaining the image status when headlights are 
recognized in the same manner. 

11 ... color TV camera, 12 ... vehicle, 13 ... decoder, 14 ... image signal 
processing part, 15... execution part, 16... vehicle velocity sensor, 17... headlight 
switching switch. 

Representative: Takehiko SUZUKI, patent attorney. 



Figure 1 

1 1 TV camera 
video signal 

13 decoder 
RGB signal 

14 image signal processing part 

1 5 execution part 

16 vehicle velocity sensor 

1 7 headlight switching switch 



Figure 2 
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Figure 3 

START 

101 Nighttime? 

102 initial setting 

1 03 image data input 

104 characteristics are extracted 
emission color [illegible] 

105 data is stored 

106 Are these tail lamps? 

1 07 Light control - are these high beams? 

1 08 Light control - are these low beams? 

1 09 image data is input 

110 the relative distance between the vehicles [illegible] is calculated 

111 the results are displayed 
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1 1 2 Are these headlights? 

1 1 3 Are these headlights with high beams? 

1 14 light control (high -> low) 

1 1 5 Low beams status in the past? 

116 light control (low -> high) 
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Figure 4 

RGB signal 

1 4 1 characteristics extraction part 

142 memory 

143 recognition part -> presence or absence of tail lamps or headlights 

144 calculation part -> the relative distance is calculated 



Figure 5 (A) and (B) 
Figure 6 
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That I am knowledgeable in the English language and in the 
language in which the below identified international document was written, and 
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Japanese Unexamined Patent Application No. 62-131837 "RECOGNTION 
DEVICE FOR DRIVEN VEHICLE", patent applicant Nippon Denso Co., Ltd., 

is a true and complete translation of the above identified document. 



all statements made on information and belief are believed to be true; and further 
that these statements were made with the knowledge that willful false statements 
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